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Detectability, Observability and Lyapunov-Type 
Theorems of Linear Discrete Time-Varying 
Stochastic Systems with Multiplicative Noise 

Weihai Zhang^, Wei Xing Zheng, and Bor-Sen Chen 


Abstract 

The objective of this paper is to study detectability, observability and related Lyapunov-type theorems of 
linear discrete-time time-varying stochastic systems with multiplicative noise. Some new concepts such as uniform 
detectability, /C°°-exact detectability (resp. -exact detectability, -exact detectability, -exact detectabil¬ 

ity) and /C°°-exact observability (resp. /C^^^-exact observability, /C^^-exact observability, /C'^-exact observability) 
are introduced, respectively, and nice properties associated with uniform detectability, exact detectability and exact 
observability are also obtained. Moreover, some Lyapunov-type theorems associated with generalized Lyapunov 
equations and exponential stability in mean square sense are presented under uniform detectability, /C^-exact 
observability and /C^-exact detectability, respectively. 

Key words: Discrete-time time-varying stochastie systems, generalized Lyapunov equations, uniform 
deteetability, exaet deteetability, exact observability. 

1. Introduction 

It is well-known that observability and detectability are fundamental concepts in system analysis and 
synthesis; see, e.g., (U, (H, (Si, I[l4l-|[l6l|, [Hill, [|20||, [|25l-|l271, (Ml, lEH. In the linear system theory, 
deteetability is a weaker concept than observability, sinee it deseribes the fact that all unobservable states 
are asymptotically stable. Over the last two decades, the classieal detectability in the linear system theory 
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has been extended to stoehastie systems in different ways. For example, the definition of stoehastie 
deteetability for time-invariant ltd stoehastie systems can be found in [|7||, [ISl, which is dual to mean 
square stabilization. In [|6l|, If^ . Il3^ . the notions of exact observability and exact detectability were 
presented for ltd stochastic systems, which led to the stochastic Popov-Belevitch-Hautus (PBH) criteria 
like those for deterministic systems. Another natural concept of detectability for ltd stochastic systems 
was given in |l6l based on the idea that any non-observed states corresponded to stable models of the 
system. In [fT9]l . the exact detectability in [[^ and detectability in |I3 were proved to be equivalent, and 
a unified treatment was proposed for detectability and observability of ltd stochastic systems. Based on 
the standard notions of detectability and observability for time-varying linear systems [[T]|, If2^ . studied 
in [l20l were detectability and observability of discrete time-invariant stochastic systems as well as the 
properties of Lyapunov equations. Recently, the exact detectability and observability were extended to 
stochastic systems with Markov jumps and multiplicative noise in [|5l, ^22^ . Il27ll . [|T7]| . 

As it is well known that the classical Lyapunov theorem is very essential in stability theory, which asserts 
that if a matrix F is Schur stable, then for any Q > 0, the classical Lyapunov equation —P + F^PF + 
Q = 0 admits a unique solution P > 0; Conversely, if (F, Q) is detectable, Q > 0, and the Lyapunov 
equation —P + F^PF -f Q = 0 admits a unique solution P > 0, then F is Schur stable. The classical 
Lyapunov theorem was generalized to deterministic time-varying systems in dH and will be extended to 
stochastic time-varying systems in this paper under any one assumption of uniform detectability, /C^-exact 
detectability and /C^-exact observability. 

Recently it has become known that discrete-time stochastic systems with multiplicative noise are ideal 
models in the fields of investment portfolio optimization |[T^ . system biology [[3T1 and so on. So the 
discrete-time stochastic H 2 /H 00 control and filtering design have been extensively studied in recent years; 
see, e.g., m, 0, m, ttn, m, umi and the references therein. As it is well-known, time-varying 
systems may be utilized to model more realistic systems and are more challenging in mathematics than 
time-invariant ones. So far, the majority of the existing results is focused on detectability of time-invariant 
systems only, except for a few about time-varying systems; see [[D, 1191- 1011 . ffT4l . ffTTl . [l26l . Il29l . [l30l . 
[l35l . Because linear time-invariant systems are not sufficient to describe many practical phenomena, this 
motivates researchers to study time-varying systems. In the classical work [HI, uniform detectability of 
the deterministic linear discrete-time time-varying (LDTV) system 



( 1 ) 
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was defined and discussed. By the duality of stochastic stabilizability, another definition called “stochastic 
detectability” was introduced in |[8l for LDTV Markov systems, which is not equivalent to uniform 
detectability in time-varying case. 

Mainly motivated by the preceding discussion and the authors’ series works [|33]|-[|36l|, this paper will 
study detectability, observability and Lyapunov-type equation related to LDTV stochastic systems with 
multiplicative noise. Firstly, the classical uniform detectability of [[ll for such systems is extended, and 
some properties on uniform detectability are obtained. By means of our Lemma lT2l given later, we obtain 
the observability Gramian matrix Ok+s,k and the state transition matrix (j)i^k, which are deterministic 
matrices and easy to be applied in practice. Specifically, we prove an important theorem that uniform 
detectability preserves invariance under an output feedback control law, which is expected to be useful in 
stochastic H 2 /H 00 control. As an application, under the assumption of uniform detectability, Lyapunov- 
type theorems on stochastic stability are also presented. 

Secondly, we extend exact detectability of linear continuous-time stochastic Ito systems |l6l, ll^ to 
LDTV systems. We introduce four concepts called /C^-exact detectability, /C^^-exact detectability, 
exact detectability and /C°°-exact detectability, and they in turn become weaker in the sense that the former 
implies the latter in a sequence. Although in linear time-invariant system 


Xk+i = Fxk, Xq e TV" 


( 2 ) 


I yk = Hxk, /c = 0,1,2,- 

these four concepts are equivalent with N = n—1, but they are different from the others in the time-varying 
case, which reveals the essential difference between time-invariant and time-varying systems. It is shown 
that uniform detectability implies /C°°-exact detectability (see Lemma 13.1.31) . and stochastic detectability 
|[8l implies the above four types of exact detectability (see Proposition 13.1.11 and Remark 13.1.31) . It 
seems that there is no inclusion relation among uniform detectability, /C^-exact detectability, /C^^-exact 
detectability and /C^^^-exact detectability, although they can be unified in the linear discrete time-invariant 
systems m- Two important Lyapunov-type theorems under /C^-exact detectability for periodic systems 
are obtained (see Theorems l3.2.1IlTT2l) . which reveal the important relation between the exponential 
stability and the existence of positive definite solutions of generalized Lyapunov equations (GLEs). 

Parallel to various definitions on exact detectability, we also introduce /C^-exact observability, /C^^- 
exact observability, /C^^^-exact observability and /C°°-exact observability, which are respectively stronger 
than /C^-exact detectability, /C^^-exact detectability, /C'^^^-exact detectability and /C°°-exact detectability. 
For the linear time-invariant system Q, and /C°°-exact observability are equivalent. 
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but they are different definitions for the linear time-varying system ([T]). We present a rank eriterion for 
/C°°- and a eriterion for /C^-exact observability based on the Gramian matrix Ok+N,k- Finally, under the 
assumption of /C^-exaet observability, a Lyapunov-type theorem is derived from Theorem I3.2.1I 

The rest of the paper is organized as follows. In Seetion[2l we define uniform deteetability and diseuss its 
properties. Lyapunov-type theorems are given under uniform deteetability. Seetion|3]introduees some new 
eoneepts about exact detectability and exposes nice properties. This section also presents Lyapunov-type 
stability theorems based on /C^-exact detectability. Moreover, the relation among uniform detectability, 
exact detectability and stochastic detectability is clarified via some examples. Section |4] introduces various 
definitions for exact observability, which are stronger than those of Section- lLTl Section |5] provides some 
comments on this study. Finally, Section concludes the paper with some remarks. 

Notation: TZ^: the set of all real n-dimensional vectors. Sn'- the set of all n x n symmetric matrices 
whose entries may be complex numbers. C: the set of all complex numbers. the set of all m x n 

real matrices. ||a;||: the norm of a vector or matrix. A > 0 (resp. A > 0): A is a real symmetric positive 
definite (resp. positive semi-definite) matrix. I: the identity matrix. a{L): the spectrum set of the operator 
or matrix L. A^\ the transpose of matrix A. Mk^ '■= {^o, ^o+l, ^0+2, • • • , especially, A/i = {1, 2, • • • , }, 
Mq = {0,1, 2, • • • , }. := {x{u) : X is Tk — measurable, i?||a;||^ < oo}. 

2. Uniform Detectability and Related Lyapunov-type Theorems 

In this section, we will define one important concept for LDTV stochastic systems, called “uniform 
detectability”. And then, we will obtain Lyapunov-type theorems under uniform detectability, which are 
extensions of classical Lyapunov theorem. 


2.1 Uniform Detectability 


Consider the following LDTV stochastic system 


{ Xk+i = FkXk + GkXkWk, xo e TZ^ 

Vk = HkXk, /c = 0,1,2, • • • , 


(3) 


where Xk is the n-dimensional state vector, yk is the m-dimensional measurement output, {tUfcjfcxo 
represents a one-dimensional independent white noise process defined on the filtered probability space 
{Vt,F,Fk,V) with Fk = cT(tp(0),--- ,w{k)). Assume that Ewk = 0, E[wkWj\ = 5kj, where 6kj is 
a Kronecker function defined by 5kj = 0 for k j while 5kj = 1 for k = j. Xq is assumed to 
be deterministic for simplicity purposes, and Ek, Gk and Hk are time-varying matrices of appropriate 
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dimension. In practice, one is more concerned about the -solution {xk}k&j\fo of stochastic difference 
equation 

Xk+i = FkXk + GkXkWk, xo e 7^”. (4) 

Definition 2.1. The stochastic vector-valued sequence {xk}k£Mo called a solution of system (H]) if (i) 
xo = xo; (ii) Xk solves (I?]) for k = 1, 2, • • •; (Hi) Xk G where T-\ = {0,12} is assumed to be a 

trivial sigma algebra. System d?]) is said to have a unique solution if for any two of its solutions {xk}k£N'o 
and {xk}k£Mo, 'F{xk = Xk,k e ffo) = 1. 

Remark 2.1. It can be found that, in most present literature, the condition (iii) in Definition 12.11 is not 
particularly pointed out when defining solutions of system dH), which is in fact an essential requirement 
as done in stochastic differential equations 11211 . This makes an fundamental difference of dll) from 
deterministic difference equations, as will be seen in the following examples. 

Example 2.1. It is easy to see that the following forward difference equation 

Xk+i = FkXk, xq e TZ"-, k = 0,1, - ■ ■ ,N 

always admits a unique solution on [0, iV + 1]. In addition, if Fk,k = 0,1, • • • , N are nonsingular, then 
the backward difference equation 

Xk+i = FkXk, xn+1 G TF", k = 0,1, - ■ ■ ,N 

also has a unique solution on [0, iV + 1]. 

Example 2.2. Obviously, the linear stochastic difference equation dH) always has a unique -solution 
Xk on any interval [0,A^ -f 1]. However, even if Fk,k = 0,1, ■ ■ ■ , N, are nonsingular, the following 
stochastic difference equation 

Xk+i = FkXk + GkXkWk, xn+1 G 1%^ (5) 

with terminal state given does not always admit an -solution. For example, if we take Fk = 1, Gk = 0, 
and the terminal state X 2 = Wi in dS]), then xi = Wi ^ Ijr^, Xq = Wi ^ l‘^_^. 

Remark 2.2. A class of backward stochastic difference equations arising from the study of discrete 
stochastic maximum principle can be found in IfT^ . 

To define and better understand the uniform detectability for system dl]), we first give some lemmas. 
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Lemma 2.1. (i) For system 0, -E||x;|p = E\\(l)i^kXk\i^ for I > k, where it is assumed that (j)k,k = f 
E given by the following iterative relation 


4>l,k = 


4>l,k+lFk 

4>tk+lGk 


, I > k. 


(ii) Xk e i if Fi and Gi are bounded for Q < i < k — 1. 


( 6 ) 


Proof: (i) can be shown by induction. For /c = / — 1, we have 

F\\xi\\^ = F[{Fi_iXi-i + Gi-iXi-iWi-iY {Fi_ixi-i + Gi-iXi-iWi-i)] 

= F[xU{Fl,Fi., + GUGi.M-i] 

= FWfi^i^iXi-iW’^. 


Hence, ® holds for /c = / — 1. Assume that for /c = m < / — 1, = F\\(f)i^raXm\\^■ Next, we prove 

= FWfi^m-iXm-iW^■ It can be seen that 

F\\xif = Flxl^fl^fi^rnXm] 

£'[(F'm—-f 1) (-^m—1 “f 1)] 

^\^rn—li.^rn—l't’l,m4’l,'mFrn—l + G^_i(j)i^^(j)i^mGm—l)Xm—l] 

F/1II • 


This completes the proof of (i). And (ii) is obvious. The proof of this lemma is complete. 
Lemma 2.2. For system 0, there holds -^lb*ll^ ^ E\\Hi^kXk\\^ for / > /c > 0, where 


Hi,k = 


Hk 

{I 2 0 F[k+l)(j)k+l,k 

{I 22 ® Hk+2)4>k+2,k 


(J2i-fc ® F[i)(f)i^k 

with Hk^k = Hk and fj^kU = k + 1, ■ ■ ■ ,1) given by 0. 


(7) 


Proof: We prove this lemma by induction. First, by a straight and simple computation, the conclusion 
holds in the case of /c = /, / — 1. Next, we assume that for /c = m < / — 1, Yl\=m -^Ibill^ = F\\Fli^mXm 


2 
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holds, then it only needs to prove Yl\=m-i = E\\Hi^rn-iXm-i\\^ ■ It can be verified that 

i i 

i=m—l i=m 


l^m—1 “1“ tjm—l^m—1) ^Hl^mi^EYn—lX^—i -\- Gffi—iXfyi—iWfy^—l)] 


E E[x^_^H^_^Hm_iXm-i] 



Hm—l 

T 

Hm—l 



Hl^mFm—1 


Hl^mEm—1 

^m—1 ^ 


Hl_^mGm—l 


Hl^mGm—1 

> 


By (|7]), it follows that 


Hm—l 

Hl^rnEm—1 

El^mGfn—l 


Hm—l 

H F ^ 

(f 2 ® Hm+l)(t^m+l ^rriFm—l 




HmG 


m—l 


^mG m—l 


(9) 


(J 2 t-m (g) Hi)(f)i^mGm-l 

On the other hand, it ean be dedueed from ® and ([7]) that 


Hi m—l 


Hm—l 
(Is (g) Hm) 


,mEm—l 

n 


{^2^ ^ Hm-\-l^ 


4^m-\-l 

0m+l 


Em-1 

Gm-1 


( 10 ) 


4^l,mEm—l 

(j-’l,mGm—l 


(/2* — m+1 ®Hi) 






















Combining (|9l) and (fTOl) together results in 


Hm—l 

T 


Hl^rnEm—1 


Hl^rnFm—l 

El^rnElm—1 




Henee, ^hiW^ = ■ This lemma is shown. 


( 11 ) 


Based on Lemmas \2.1U2.2l we are now in a position to define the uniform deteetability for system dS]). 

Definition 2.2. System (13) or (F^, Gk\Hk) is said to be uniformly detectable if there exist integers s,t >0, 
and positive constants d, b with 0 < d < 1 and 0 < 6 < oo such that whenever 

E\\xk+t\\'^ = E\\(t)k+t,kXk\? > d^F||xfc|p, (12) 


there holds 

k+s 

Y, E\\y,f = E\\Hk+s,kXk\? > h‘^E\\xk\\\ (13) 

i=k 

where k G A/q. (j)k+t,k cmd Hk+s,k are the same as defined in Lemma 12.21 


Obviously, without loss of generality, in Definition 12.21 we ean assume that t < s. By Lemmas 12.1112.2[ 
the uniform deteetability of {Ek,Gk\Hk) implies, roughly speaking, that the state trajeetory deeays faster 
than the output energy does. In what follows, Ok+s,k ■= kHk+s,k is ealled an observability Gramian 
matrix, and fi^k a state transition matrix from Xk to xi of stoehastie system (|3]). So (fTSl) ean be written as 
E[xlOk+s,kXk] > If Gfc = 0 for k > 0, then system (|3) reduces to the following deterministic 

system 


Xk+i = EkXk, xq eVf, 
Uk HkXk) 


(14) 


which was discussed in [[11, Il23l . 

Similarly, uniform observability can be defined as follows: 


Definition 2.3. System (13) or {Ek,Gk\Hk) is said to be uniformly observable if there exist an integer 
s > 0 and a positive constant b > 0 such that 


E\\Hk+s,kXk\\‘^ > b‘^E\\xk\\‘^ 


holds for each initial condition Xk G k G A/q- 














Remark 2.3. Different from the uniform deteetability concept, uniform observability needs that any 
models (unstable and stable) should be reflected by the output. This section concentrates on the uniform 
detectability of system ([3]), since it is weaker than uniform observability. Uniform observability is also an 
important concept, which will be further studied in the future. 

Definition 2.4. System di]) is said to be exponentially stable in mean square (ESMS) if there exist /9 > 1 
and A G (0,1) such that for any < k < +cxo, there holds 

E\\xkf (15) 

Proposition 2.1. If system (|2]) is ESMS, then for any bounded matrix sequence {Hk}k>Q, system (|2]) is 
uniformly detectable. 

Proof: By Definition I2.4[ for any k,t>D, we always have 

E\\xk+t\? = EWfk+ckXkW^ < ldE\\xk\\^\\ > 1, 0 < A < 1. (16) 

By ([HI), /9A‘ —)■ 0 as f —)■ cxo. Set a large to > 0 such that 0 < := < 1. Then, for any fixed t > to, 

([T^ holds only for Xk = 0, which makes (IT3]) valid for any s > t > to and fe > 0 with an equality. So 

system (|3]) is uniformly detectable. ■ 

Remark 2.4. For system ([T4l) . Definition 12.21 reduces to Definition 2.1 in [[T]|. It is easy to prove that 
uniform detectability coincides with classical detectability of the linear time-invariant system (O. 

The following lemma will be used throughout this paper. 

Lemma 2.3 (see ifTdl l. Eor a nonnegative real sequence {sk}k>ko> If there exist constants Mo > 1, 
do £ (0,1), and an integer /iq > 0 such that Sk+i < MoSk and minfe+i<j<fc_|_/iQ Sj < 6oSk, then 

Sk < VA: > ko- 

The following proposition extends Lemma 2.2 in ifTll . 

Proposition 2.2. Suppose that {Ek, Gk\Hk) is uniformly detectable, and Ek and Gk are uniformly bounded, 
i.e., ||Ffc|| < M, ||(i?fc|| < M, M > 0. Then \imk-,oo E\\yk\\^ = 0 implies limfc^oo= 0. 

Proof: If there exists some integer ko such that for all k > ko, = E\\(l)k+t,kXk\\^ < 

d^E\\xk\\‘^, then mmk+i<i<k+t -E||xi|p < d‘^E\\xk\\‘^. Moreover, UUxi+ip = EWfi+i^iXiH"^ = E[xf{E^Ei + 
GfGi)xi] < < MoU||a;j|p, where Mq = max{2M^, 1} > 1. By Lemma [23l not only does 
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linifc^oo= 0, but also is system ([3]) ESMS. Otherwise, there exists a subsequenee {ki}i>Q sueh 
that > d?E\\xki\\^- Now, for k G {ki,ki+i), we write k = ki + l + ta + l3 with (3 <t, then 

E\\xk i+l+at IP < c?“E||xfc^+i|p, 

E\\Xk^-^-l-^-at+f^ IP < {2MyE\\xk i 11 5 

^||a;fci+i|P < 2M^E||xfcJp. 

Therefore, we have 


E\\xk\\^ = E\\xk,+,^^t+4" < {2Myd'^E\\xk^+,f 
< {2My+^d^E\\xk,f. 


(17) 


Obviously, in order to show limfc_).oo -EHoifclP = 0, we only need to show limfc.^-oo E\\xki IP = 0- If it ^^ot 
so, then there are a subsequenee {ni}i>o of {fci}i>o and <^ > 0, such that E’Hx^Jp > e, E\\(pni+t,niXni\\'^ > 
d‘^E\\xn^\\‘^. By Definition 12.21 

^ E\\yif = E[x'^Prii+s,niXni] > 6^^||x„jp > (18) 

i=ni 

Taking n* —)■ oo in (fTSl) . we have 0 > > 0, which is a contradiction. Hence, the proof is complete. ■ 

In the remainder of this section, we will prove the output feedback invariance for uniform detectability. 
Consider the following LDTV stochastic control system 


{ Xk+i = {EkXk + MkUk) + {GkXk + NkUk)wk, 

Hk = HkXk, A; = 0,1,2, • • • . 


(19) 


Applying an output feedback control law Uk = KkUk to (fT9l) yields the following closed-loop system 


{ Xk+i ^Ek T ]\dkKkHk')Xk T (Gfc T EfkKkHk')XkWki 

Vk = HkXk, A: = 0,1,2, • • • . 


( 20 ) 


Theorem 2.1. If {Ek, Gk\Hk) is uniformly detectable, then so is {Ek + MkKkHk, Gk + NkKkHk\Hk). 
Proof: By Lemma [T2l the observability Gramian for system (l20l) is Ok+s,k = k^k+s,k, where 


H 


k-\-s^k 


Hk 

{I2 ® HkJ^i)^k+l,k 
{I 22 (g) H]^j^2)^k+2,k 


4^k-\-i,,k 


4^k-\-i,,k-\-\P'k 
4^k+i,^k-\-lG k 


(/2s (g) 


I,** 


5. 
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^3 — ^3 + ^^3^3^3-: ^3 


Gj -\- NjKjHjj j — /c, /c -|- 1, • • • , /c -|- s. 


To prove that {Fk,Gk\Hk) is uniformly detectable, it suffices to show that there are constants 6 > 0, 
0<(J<1, s,t>0 such that for ^ G k G Mo, whenever 

E[xlOk+s,kXk] < P-Ellxfcll^ (21) 

we have 

E\\M+t,kXk\\‘^ < <PE\\xk\\‘^. (22) 


It is easy to show 


I 0 


Hk+s,k Q k+s,kH k+s,k, Qk+s,k 


0 

0 


* * ■ ■ ■ I 


where * represents terms involving Hi, Mi, Ki and M, i = k,k + l, - ■ ■ ,k + s. Hence, for any Xk G 


pE[xlOk+s,kXk] < E[xlOk+s,kXk] < gE[xlOk+s,kXk], 


(23) 


where p = \ra\n{Ql+s,kQk+s,k) > 0, ^ = XmMQk+s,kQk+s,k) > 0. In addition, by observation, for any 

Z > /c > 0, 

(pl,k = <Pl,k + Rl,kHi^k, 


where Ri^k is a matrix involving Hi, Mi, and iVj, i = k,k + l, - ■ ■ , Z — 1. If we take 0 < 6 < y/pb, then 
it follows from (l23l) that E[x'lOk+s,kXk] < ^E[x'lOk+s,kXk] < < b‘^E\\xk\\‘^- By the uniform 

observability of {Fk,Gk\Hk), it follows that 

■Zi^||0fc+t,fca'fc II E^(j)k-\-t,kXk T Rk+t,kHk+t,kXk^ 

< 2E\\(t)k+t,kXk\\‘^ + 2p^E\\Hk+t,kXk\\^ 

< 2d^E\\xkf+ 2p^E[xlO 

/c+Sj/c^A:] 

< {2(f + 2p^^-)E\\xkf 

P 

= dE\\xk\\‘^, (24) 

where p = sup^ \\Rk+t,k\\, d = 2d? + 2/i^^. If we take h to be sufficiently small, then cZ < 1, which yields 
the uniform detectability of {Fk,Gk\Hk)- Hence, the proof of this theorem is complete. ■ 


Theorem 12.11 reveals that the output feedback does not change uniform detectability. 
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Example 2.3. For simplicity, we set s = 1. Then it ean be eomputed that 



Hk 


Hk 

Hk+l,k — 

{I 2 (8) Hk+i)fk+i,k 


Hk+i{Fk + MkKkHk) 

Hk+i{Gk + NkKkHk) 





Hk 


Hk 



Hk+i,k — 

{I 2 G) Hk+i)(j)k+i,k 

— 

Hk+iFk 




Hk+iGk 


Obviously, 

Qk+l,k 

Example 2.4. By definition, we have 


/ 0 0 
Hk+iMkKk I 0 

Hk+iNkKk 0 / 


0A;+l,fc — 


Fk + MkKkHk 


Gk + NkKkHk 

Henee, (j)k+i,k = 4’k+i,k + Rk+i,kHk+i,k with Rk+i,k = 


, 4’k+l,k — 

MkKk 0 0 
NkKk 0 0 


Fk 

Gk 


2.2 Lyapunov-Type Theorems under Uniform Detectability 

In the following, we will further study the following time-varying GLE 

— Pk + F^Pk+iFk + G^Pk+iGk + Hk = 0, k = 0,1, 2, 


(25) 


under uniform deteetability. The aim of this subseetion is to extend the classieal Lyapunov theorem to 
GLE (|25]) . To study (l25l) . we first introduee the following finite time baekward differenee equation 

f ^Pk,T P F^Pk+i^xFk + G^Pk+i^TGk + H'[Plk = 0, 

< (26) 

Pt,t = 0, k = 0,1, ■ ■ ■ ,T — 1; T G A/i- 
Obviously, equation (|2^ has nonnegative definite solutions Pk,T > 0. 


Proposition 2.2.1. R monotonically increasing with respect to T, i.e., for any ko < Ti < T 2 < +C)0, 

Pko,Ti < Pko,T2, ko e {0, 1, • • • ,Ti}. 

Proof: Obviously, Pk,Ti and Pk,T 2 solve 

( —Pk,Ti + F^ Pk+i^TiFk + G"[Pk+i,TiGk + H^Hk = 0 , 

[ Pti,Ti =0, fc = 0,1, • • ■ , Ti — 1, 


(27) 
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and 


-Pk,T, + F^Pk+i,T,Fk + GlPk+i,T,Gk + HjHk = 0, 

^T2,T2 = 0, /c = 0,1, • • • , T 2 — 1, 


( 28 ) 


respectively. Consider the following LDTV stochastic system with a deterministic initial state Xk^: 


( Xk-\-l Fk^k “f GkXkWki 

Xko e 7 ^", k = ko,ko + l, - ■ ■ . 

Associated with (l29l) . in view of (ITT]) , we have 

Ti-l Ti -1 

^[^k^kHkXk] = E[xlHlHkXk + xYPk+l,TrXk+l - xlPk,TrXk\ 

k=kQ k=ko 

+ ^ko^ko,TiXko - E[x'^^Pti,TiXti] 

Ti -1 

= ^[^k{~Fk,Ti + F'^Pk+l,TiFk + G^Pk+l^TiGk + H^Hk)Xk\ 

k=ko 

+ xl^Fko,nXko 

^ko^ko,TiXkQ- 


(29) 


(30) 


Similarly, 


From (I30l)-(|3TI). it follows that 


T 2-1 

Y, E[xlHlHtx,] 

k=ko 


^ko^ko,T2^ko • 


(31) 


Ti-l T2-I 

0 < F[xlH^HkXk] = xl^Pko,TiXko < Y ^[^kHlHkXk] = xl^Pko,T2Xko- (32) 

k=ko k=ko 

The above expression holds for any Xk^ G which yields Pko,Ti < Pko,T 2 - Thus, the proof is complete. 


Proposition 2.2.2. If system (ED is ESMS, and Hk is uniformly bounded (i.e., there exists M > 0 such 
that \\Hk\\ < M, \/k E Mo), then the solution Pk^x 0 / (|2^ is uniformly bounded for any T G Mi and 
k G [0,T]. 

Proof: By (l30l) . for any deterministic Xk G 7?.”, we have 

T-l 00 

xlPk,TXk = Y^\.^'^HjMxi] < YE[^lHlMxi] 

i=k i=k 

00 ^ 

i=k 

which leads to that 0 < Pk,T < since Xk is arbitrary. Hence, the proof is complete. ■ 
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Combining Proposition 12.2.11 with Proposition 12.2.21 yields that := Yim.T^ooPk,T exists, which is a 
solution of (125]) . Hence, we obtain the following Lyapunov-type theorem. 

Theorem 2.2.1 (Lyapunov-Type Theorem). If system di]) is ESMS and {Lffc}fcGA/b is uniformly bounded, 
then d231) admits a unique nonnegative definite solution {TfcjfcGA/b- 

The eonverse of Theorem 12.2.11 still holds. 

Theorem 2.2.2 (Lyapunov-Type Theorem). Suppose that {Fk.,Gk\Hk) is uniformly detectable and Fk 
and Gk are uniformly bounded with an upper bound M > D. If there is a bounded nonnegative definite 
symmetric matrix sequence {Pk}k>o solving GLE d231) . then system (13) is ESMS. 

Proof: For system ([3]), we take a Lyapunov funetion as 

Vk{x) = x^{Pk + el)x, 

where £ > 0 is to be determined. For simplieity, in the sequel, we let 14 := Vkixk)- It is easy to eompute 


EVk - EVk+i = E[xl{Pk + el)xk] - E[xl^fPk+i + el)xk+i] 


= E[xl{Pk -f el)xk] - E[{FkXk + GkXkWk)'^{Pk+i + eI){FkXk + GkXkWk)] 
= E[xl{Pk - FJ Pk+iFk - GlPk+iGk)xk] + eE[xl{I - FJ Fk - GlGk)xk] 
= EWvkf + eE[xl{I - F^Fk - GlGk)xk] 

= E\\yk\\'^ + eEWxkW^ - eE\\xk+i\\‘^. 


(33) 


Identity (l33) yields 

EVk — EVk+s+i = [EVk — FI4+1] + [FI4+1 — FI4+2] + • • • + [EVk+s — EVk+s+\\ 


= ^ E\\yi\\^ + eE\\xk\\‘^ - eE\\xk+s+i\\‘^■ 


(34) 


i=k 


When Yl!i=k — i^‘^E\\xk\\‘^, we first note that 

-E'll^fc+s+iII = -|- Gkj^s^k+s)Xk+s} 


< 2M^E\\xk+s\? < {2M^fE\\xk+s-i\? < ■ 

< {2My+^E\\xk\\\ 


(35) 


Then, by (l34l) . we still have 

EVk - EVk+s+i > h‘^E\\xk\\^ + eE\\xk\\^ - e{2My+^E\\xkf 
= [fe2 + £-£(2M2)^+i]F|4fcf. 


(36) 
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From (l36l) . it readily follows that 


EVk+s+i < EVk - + £[1 - {2M‘^y+^]}E\\x4^ 

[b‘^ + s[l - (2M2)"+i]] 


< n - 


EVk. 


(37) 


^max {Pk + el) 

Considering that {P^ > OjfceTVb is uniformly bounded, if e is taken to be suffieiently small, then there 
must exist a 5 G (0,1) such that 


EVk+s+i < bEVk- (38) 

When Yl!i=k^\\yi\\^ ^ b‘^E\\xk\y, by uniform detectability we have i7||a;fc+t|p < (fE\\xk\y. From (l34l) . 
it follows that 


EVk - EVk+t > eE\\xkf - ed^EWx^y = £(1 - dyE\\xk\\\ (39) 

Similarly, we can show that there exists a constant (5i G (0,1) such that 

EVk+t < hEVu. (40) 

Set 5o := max{(5, (5i}, in view of (1381) and (l40l) . we have 

min EVi < d^EVk, Vfc > 0. (41) 

fc+l<7</c + S + l 

From identity (|3^ . we know 

EVk+i < EVk + < EVk + eEVk+i- (42) 

Taking 0 < e < 1 in (l42l) . it is easy to derive that there exists a positive constant Mq > 1 satisfying 

EVk+i < MoEVk, yk > 0. (43) 

Applying Lemma l23] with Sk = EVk, ho = s + 1, (3 = [Mq°(5o~^], A = 6q°, it follows that 

EVk < /3A^^-^°^EVk, < Xm.yPk + eI)yX^^-’^°^E\\xk,\\y 

which implies that system (|3]) is ESMS due to the fact that {Pk}k>o is uniformly bounded. ■ 

The above theorem directly yields the following result. 

Corollary 2.2.1. Suppose that there exists e > 0 such that > el for k G A/q- Additionally, if there 

is a uniformly bounded symmetric matrix sequence {Pk P 0}fc>o solving GLE t l25l) . then system (O is 


ESMS. 
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3. Exact Detectability and Related Lyapunov-type Theorems 


We recall that for the linear time-invariant system 


{ Xk+i = Fxk + GxkWk, xo e TV^ 

Hk = Hxk, fc = 0,1,2, • • • 


(44) 


its exact observability was defined in EOll . Il34ll . while the same definition for linear continuous-time time- 
invariant ltd systems was given in Il3^ . For the LDTV stochastic system ([3]), the complete observability 
that is different from the uniform observability [l8]| was defined in lf35ll . In this section, we will study 
exact detectability of the stochastic system ([3]), from which it can be found that there are some essential 
differences between the time-varying and time-invariant systems. In addition, Lyapunov-type theorems are 
also presented. 


3.1 Exact Detectability 

We first give several definitions. 

Definition 3.1.1. For system (0), Xk^ G 1% Is called a k'^-unobservable state if yk = 0 a.s. for 

fco 1 

k G [fco, cxd), and Xk^ G 1%, is called a kl°-unobservable state if yk = 0 a.s. for k G [fco, fco + so]. 

Remark 3.1.1. From Definition 13.1.11 we point out the following obvious facts: (i) If Xk^ is a kf"- 
unobservable state, then for any so > 0, it must be a fcg°-unobservable state; (ii) If Xk^ is a fcg^-unobservable 
state, then for any 0 < so < si, it must be a fcg®-unobservable state. 

Example 3.1.1. In system ([3]), if we take fcffc = 0 for fc > fco, then any state Xk^ G is a kf- 

unobservable state. For any fco > 0, XkQ = 0 is a trivial fcg°-unobservable state. 

Different from the linear time-invariant system (l44l) . even if Xk^ = C is a fc“-unobservable state, Xk^ = C 
may not be a fc^^-unobservable state for any si > 0, which is seen from the next example. 


Example 3.1.2. Consider the deterministic linear time-varying system with = 0 and 

, if fc is even. 


< 

1 0 

/ 

- 1 

o 

o 

> 

1 

o 

o 

_ 1 

< 

0 1 


, if fc is odd. 
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Obviously, Xq 


0 

1 


is a 0°°-unobservable state due to = 0 for /c > 0, but Xi 


0 

1 


is not a 


pi-unobservable state for any Si > 0 due to yi = Hi 


0 


7 ^ 0, let alone 1°°-unobservable state. 


1 

Definition 3.1.2. System (12]) is called k'^-exactly detectable if all -unobservable state ^ is exponentially 

stable, i.e., there are constants /9>1, 0<A<1 such that 


E\\xkf < yk>ko. 


(45) 


Similarly, system di]) is called -exactly detectable if d45l) holds for all kl°-unobservable state 

Definition 3.1.3. System (|21) (or (Ek,Gk\Hk)) is said to be lC°°-exactly detectable if it is k°°-exactly 
detectable for any k > ft. If there exists a nonnegative integer sequence {sk}k>o with the upper limit 
linifc^ooSfc = -l-oo such that system di]) is k^*^-exactly detectable, i.e., for any k^’^ -unobservable state ^k, 

E\\xtf < l3E\\ik\?\^^-^\ /3 > 1, 0 < A < 1, f > fc, 

then system dil) (or (Ek, Gk\Hk)) is said to be weakly finite time or -exactly detectable. If limfc_j.ooSA: < 

-l-cxo, then system di]) (or (Ek,Gk\Hk)) is said to be finite time or -exactly detectable. 

A speeial case of /C^^-exact detectability is the so-called /C^-exact detectability, which will be used 
to study GLEs. 

Definition 3.1.4. If there exists an integer N > ft such that for any time k^ G [0, oo), system di]) 
(or (Ek,Gk\Hk)) is k^-exactly detectable, then system di]) (or (Ek,Gk\Hk)) is said to be -exactly 
detectable. 


From Definitions 13.1.3143X41 we have the following inclusion relation 

/C^-exact detectability /C^^-exact detectability 
/C'^^^-exact detectability /C°°-exact detectability. 

In this paper, we will mainly use /C°°- and /C^-exact detectability. Obviously, /C^-exact detectability 
implies /C°°-exact detectability, but the converse is not true. We present the following examples to illustrate 
various relations among several definitions on detectability. For illustration simplicity, we only take the 
concerned examples to be deterministic. 
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Example 3.1.3. In system (fT4l) . we take = 1 for fc > 0, and 

f 1, for fc = n = 1, 2, • • • , 

Hk= I 

I 0, otherwise. 

In this case, system (fT4l) (or {Fk\Hk)) is /C°°-exactly detectable, and the zero vector is the unique k°°- 
unobservable state. {Fk\Hk) is also /C'^^^-exactly detectable, where Sk = k'^ — k ^ oo. However, {Fk\Hk) 
is not /C^^-exactly detectable, and, accordingly, is not /C^-exactly detectable for any N >0. 

Example 3.1.4. In system (fT4l) . if we take Fk = 1 and Hk = ^ for k > 0, then {Fk\Hk) is /C^-exactly 
detectable for any > 0, but {Fk\Hk) is not uniformly detectable. This is because for any t > 0, 
0 < d < 1 and ^ e TZ, we always have \(j)k+t,k^\‘^ = I'CP > But there do not exist b > 0 and s > 0 

satisfying ([I3]), because ^^Ok+s,k^ = ES ^ while lim^^oo ES ? = 0- 

Example 3.1.5. In system (fT4l) . if we take Fk = 1 for k > 0, and Fl 2 n = 1 and H 2 n+i = 0 for 

n = 0,1, 2, • • •, then {Fk\Hk) is uniformly detectable and /C^-exactly detectable, but it is not /C°-exactly 
detectable. 

The following lemma is obvious. 

Lemma 3.1.1. At any time k^, Xk^ = 0 is not only a k’^- but also a kl°-unobservable state for any 

So > 0. 

By Lemma I3.1.1[ if we let 0^ denote the set of all the fc^-unobservable states of system (jS]) at time 
/co, then 0^ is not empty. Furthermore, it is easy to show that 0^ is a linear vector space. 

Lemma 3.1.2. For k^ G Mq, if there does not exist a nonzero ( G 71"^ such that id^oC = 0, (/ 2 *-fco ® 

Hi)fi,koC = 0> I = ki) + l^kf) + 2, ■ ■ ■, then = 0 a.s. with k > ko implies Xko = 0 a.s.. 

Proof: From pk^ = 0 a.s., it follows that 

E[xl^Hl^Hk^Xkf\ = 0. (46) 

From yi = D a.s., I = k^ + l, • • •, it follows from Lemma [2^ that 

^\Fko^l,koi^2^-*=o ® ® Hl)fl,koXkQ\ = 0. (47) 

Let RkQ = E[xkQxl^, rank/?fcg = r. When r = 0, this implies Xk^ = 0 a.s., and this lemma is shown. For 
1 < r < n, by the result of [l24ll . there are real nonzero vectors zi, ^ 2 , •'' > such that Rk^ = Ei=i ■ 
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By (|4^ . we have 

E[xl^Hl^Hk^Xk^] = ti&ceE[Hl^Hk^Xk^xl^] 

= tia.ce{Hl^Hk^E[xkoxl^]} 

r 

= trace{i/J^i/fco 

i=\ 

V 

= y^l2fi/J„ft„z,| = 0, (48) 

i=\ 

whieh gives Hk^Zi = 0 for i = 1, 2, • • • , r. Similarly, (HTI) yields 

{l 2 i-ko ® Hi)(t)i^koZi = 0, i = 1, 2, • • • , r. 

Aeeording to the given assumptions, we must have 2 ;* = 0, i = 1, 2, • • ■ , r, which again implies Xk^ = 0 
a.s.. ■ 

By Lemma I3.1.2[ it is known that under the conditions of Lemma I3.L2[ Xk^ = 0 is the unique /cg°- 
unobservable state, i.e., 0^ = {0}. 

Lemma 3.1.3. Uniform detectability implies lC°°-exact detectability. 

Proof: For any fco°°-unobservable state Xk^ = by Definition 12.21 and Definition I3.L3[ we must 
have E\\(l)k+t,kXk\\‘^ < (PE\\xk\\^ or = 0 for k > ko; otherwise, it will lead to a contradiction since 

k-\-s 

0 = '^EWyiW^ > b\\xk\\^ > 0 . 

i=k 

Under any case, the following system 

Xk-\-i Fj^xj^ 

< = (49) 

yk = HkXk, k = 0,1,2,-■■ 

is ESMS, so {Ek,Gk\Hk) is exactly detectable. ■ 

Remark 3.1.2. When system dH) reduces to the deterministic time-invariant system dZl), the uniform 
detectability, /C”“^-exact detectability and /C°°-exact detectability coincide with the classical detectability 
of linear systems ifT^ . Examples I3.L4M3T3] show that there is no inclusion relation between uniform 
detectability and /C^-exact detectability for some N > 0. We conjecture that if {Ek,Gk\Hk) is uniformly 
detectable, then there is a sufficiently large N > 0 such that {Ek,Gk\Hk) is /C^-exactly detectable. 

Corresponding to Theorem 12.1[ we also have the following theorem for exact detectability, but its proof 


is very simple. 
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Theorem 3.1.1. If {Fk, Gk\Hk) is ]C°°-exactly detectable, then so is {Fk + MkKkHk,Gk + NkKi^Hk\Hf) 
for any output feedback Uk = 

Proof: We prove this theorem by contradiction. Assume that + M^K^FIk^Gk + NkKkHk\Hk) 
is not /C°°-exactly detectable. By Definition 13.1.31 for system (l20l) . although the measurement equation 
becomes pk = H^Xk = 0 for A; G A/o> the state equation 

Xk+i (,Fk F MkKkHk'jXk 3“ (Gfc F NkKkFlk)XkWk (50) 

is not ESMS. In view of pk = HkXk = 0, (l50l) is equivalent to 

Xk+i = FkXk F GkXkWk. ( 51 ) 

Hence, under the condition of pk = HkXk = 0 for k = if (l50l) is not ESMS, then so is (|5TI) . 

which contradicts the /C°°-exact detectability of {Fk.,Gk\Hk). ■ 

It should be pointed out that Theorem 13.1.11 does not hold for /C^-exact detectability. That is, even if 
{Fk,Gk\Hk) is /C^-exactly detectable for > 0, (F). + MkKkHk,Gk + NkKkHk\Hk) may not be so, 
and such a counterexample can be easily constructed. 

Proposition 3.1.1. If there exists a matrix sequence {Kk, /c = 0,1, • • ■ , } such that 

Xk+i = (Ffc + KkHk)xk F GkXkWk (52) 

is ESMS, then {Fk,Gk\Hk) is lC°°-exactly detectable. 

Proof: Because (l52l) is ESMS, by Proposition 12.II and Eemma [3.1.31 (F^ + KkHk,Gk\Hk) is /C°°- 
exactly detectable. By Theorem 13. Eli for any matrix sequence k = 0,1, • • • , }, (F^ + KkHk F 
LkHk,Gk\Hk) is also /C°°-exactly detectable. Taking Lk = —Kk, we obtain that {Fk,Gk\Hk) is /C°°- 
exactly detectable. Thus, this proposition is shown. ■ 

Remark 3.1.3. In some previous references such as jHll, ll29ll . if system (l52l) is ESMS for some matrix 
sequence {Kk}kej\ro^ then (F^, Gk\Hk) is called stochastically detectable or detectable in conditional mean 
ll29l . Proposition 13.1.1! tells us that stochastic detectability implies /C°°-exact detectability, but the converse 
is not true. Such a counterexample can be easily constructed; see the following Example 13.1.61 The 
/C°°-exact detectability implies that any A;g°-unobservable initial state ^ leads to an exponentially stable 
trajectory for any ko > 0. However, in the time-invariant system (|44|), the stochastic detectability of dH]) 
(or {F,G\H) for short) is equivalent to that there is a constant output feedback gain matrix K, rather 
than necessarily a time-varying feedback gain matrix sequence {Kk}keAfo, ^'^^h that 


Xk+i = {F F KH)xk + GxkWk 


(53) 
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is ESMS; see If8l . 


Example 3.1.6. Let = 3 for /c > 0, and 



1, for k = 3n, n = 1, 2, • • • , 
0, otherwise. 


By Lemma IITI for any output feedbaek Uk = KkUk, we have Ex\ = 3^^ for k > ko, where Xk 

is the elosed-loop trajectory of 

Xk+i = {Ek + KkHk)xk + 3xkWk, 

which is not ESMS. So {Ek,Gk\Hk) is not stochastically detectable. However, {Ek,Gk\Hk) is not only 
/C°°- but also /C^-exactly detectable, and 0 is the unique /c^-unobservable state. 

Remark 3.1.4. According to the linear system theory, for the deterministic linear time-invariant system 
dll), the 1C°°- and /C"“^-exact detectability are equivalent. By the ^{-representation theory [[351, for (1^ . the 
/C°°- and K\ ^ ^ -exact detectability are also equivalent. So, in what follows, system (|4^ (or (F, G\H)) 
is simply called exactly detectable. 

Remark 3.1.5. In Example [3. 1.31 {Ek\E[k) is stochastically detectable, but it is not /C^-exactly detectable 
for any > 0. In Example 13. 1.61 {Ek\Hk) is not stochastically detectable, but it is /C^-exactly detectable 
for > 3. Hence, it seems that there is no inclusion relation between stochastic detectability and /C^-exact 
detectability. 

3.2 Lyapunov-Type Theorems under Exact Detectability 

At present, we do not know whether Theorem 12.2.21 holds under exact detectability, but we are able to 
prove a similar result to Theorem 12.2.21 for a periodic system, namely, in ([3]), Ek+r = Ek, Gk+r = Gk, 
Hk+T = Hk- Periodic systems are a class of very important time-varying systems, which have been studied 
by many researchers; see O, (HI, ifTOll . 

Theorem 3.2.1 (Lyapunov-Type Theorem). Assume that system (H]) is a periodic system with the period 
r > 0. If system (|21) is K.^-exactly detectable for any fixed N >D and {Pk > 0}fc>o is a positive definite 
matrix sequence which solves GLE (251) . then the periodic system (H]) is ESMS. 

Proof: By periodicity, Pk = Pk+r- Select an integer k > 0 satisfying Rr — 1 > N. Eor k > k, we 
introduce the following backward difference equation 


-Pf^-\k) + PlPf^-\k + l)Pk + GlPf^-\k + 1)G, + H^Hk = 0, 

Pq'^~^{k,t) = 0, k = 0,1, ■■■, KT — 1. 


iT ryKT—l 


(54) 
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Set Vk = xiPkXk, then assoeiated with (l54l) . we have 

EVq - EVf,r = XqPqXo - E[xl^Pf,rXnT] = XqPqXq - E[xl^PoX^r] 

K,T—1 

= 5^E|||/,||2 = 4p--1(o)xo, (55) 

i=0 

where the last equality is derived by using the eompleting squares teehnique. We assert that > 0. 

Otherwise, there exists a nonzero Xq satisfying Xq Pq'^~^{0)xo = 0 due to Pq'^~^{0) > 0. As so, by /C^- 
exaet deteetability, (l55l) leads to 

Atr—1 

0 = E\\y,f > A^i„(Po)llxoir - A^a.(Po)/5A""|la;o||' 

i=0 

= {KiniPo) - KUPo)/3XnM\ (56) 

where (3 > 1 and 0 < A < 1 are defined in ([T?]) . If k is taken sufficiently large such that k > kq > 0 
with Ko > 0 being a minimal integer satisfying Ainin(Po) — Amax(Po)/5A'*'°'^ > 0 , then (l5^ yields xq = 0 , 
which contradicts Xq 7 ^ 0 . 

If we let P^n-i)KT((''^ — 1 )k,t + k) denote the solution of 

' - 1 )'=^+>=) + p-i)„+.-P(rip((" -1)'=^+ + i)f’(n-i).x+» 

^ P^fn-l)KT+kP{n-l)KT(i''^ ~ l)fi;r + k + l)G[n-l)KT+k + ~ 

, = 0 ’ /C = 0 , 1 , • • • , KT - 1 ; 72 = 1 , 2 , • • • , 

then by periodicity, Po'"^“^( 0 ) = ~ > 0 ’ 

riAcr—1 

EV(^n-l)nr “ = Y1 ^11^*11^ = “ 1 )Kr)X(„_i)«,] 

i={n—l)K,T 

~ -^[^(n-l)KT-^O ( 0 )a:(„_i)f 5 T-] > ^o||^(n-l)Kr II ) 

where qq = Xmin{Po^~^) > 0. Generally, for 0 < s < kt — 1, we define — 1)kt + s + fc) 

as the solution to 

^ ((^ - +s+k)++s+k+ i)P(._i)..+.+, 

^ {n-l)KT+s+k^{n-l)KT+s(('^ ~ 1)kT + S + + 1)G(^n-l)KT+s+k + -^(„_i)Kr+s+fc-^(»i-l)«:T+s+fc ~ 6 ) 

^ + S) = 0 , /C = 0 , 1 , • • • , KT - 1 ; 72 = 1 , 2 , • • • . 

It can be shown that P("'!r()®~:J:^((72 — l)Kr + s) = > 0 and 

nK.T-\-S — l 

Y, EUf = 

i={n—l)KT+s 
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provided that we take k > maxo<s<Kr-i where > 0 is the minimal integer satisfying Amin(-Ps) — 
An.ax(P.)/9A"^" > 0. 

Summarizing the above diseussions, for any /c > 0 and k > max{K, maxo<s<Kr-i we have 

fc+^r—1 

EVk-EVu+f.r= Y. E\\y,\;^ > pE\\xk\\\ 

i=k 

where p = mino<s<Kr-i Ps > 0 with ps = A mjn [Pf'^'*~^~^(5)]- The rest is similar to the proof of Theo¬ 
rem 12.2.21 and thus is omitted. ■ 

In Theorem 13.2.1[ if {Pk > 0}fc>o is weaken as {Pk > 0}fc>o, then we have 

Theorem 3.2.2 (Lyapunov-Type Theorem). Assume that system (21) is a periodic system with the period 
T > 0. If (i) system (2)) is K,^-exactly detectable for any fixed N > 0; (ii) {Pk > 0}fc>o is a positive 
semi-definite matrix sequence which solves GLE f[25l) ,' (Hi) Ker(Po) = Ker(Pi) = ■ ■ ■ = &r(P.r-i). then 
the periodic system (21) is ESMS. 


Proof: From GLE (l25l) . it is easy to show (e.g., see Theorem 3.2 in ll34ll ) that Ker(Pfc) C Ker(Pfc), 
PfcKer(Pfc) C Ker(Pfc+i), GfcKer(Pfc) C Ker(Pfc+i). In addition, in view of Ker(Po) = ■ ■ ■ = Ker(Pr-i) 
and P-r+k = Pk, there is a common orthogonal matrix S such that for any k > 0, there hold 


S^PkS = 


0 0 

0 Pf 


Pf > 0, 


HiHkS = 


0 0 
0 


Pf 

pf 

, S'^GkS = 

^11 

^12 

0 

Pf. 


0 

Gf_ 


Pre- and post-multiplying S'^ and S on both sides of GLE (l25l) gives rise to 


S^ PkS + S^P^S- S^ Pk+iS • S^ EkS + S^ GiS • S^ Pk+iS • S^'GkS + S^'HfS • HkS = 0, 


^Tr^T 


which is equivalent to 


- P^ + iPkYPkliPk^ + (GlYP^lGf + (Pf = 0. 


T 


Vi,k 

= S^Xk = 

Sn 

S 12 

1 

Xk, then it follows that 

V2,k 


S 21 

S 22 



Pyk+i = T’f Pi,fc -f G]}pi^kWk + pf P2,fc + Gl^p2,kWk, 
' V2,k+1 = Pf P2,fc + Gfp2,kWk, 


(57) 


(58) 


Vk HkSpk' 
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It can be easily seen that i/k = HkSrjk = 0,a.s. iff = 0,a.s., for whieh a suffieient condition 

is ri 2 ^k = 0. By /C^-exact detectability, rji^k+i = F^^Vi,k + Gk^Vi,kWk is ESMS. To show that ri 2 ^k+i = 
Fk'^V 2 ,k + G‘f‘7]2^kWk is ESMS, we eonsider the following redueed-order state-measurement equation 


j m,k+i = + Gfr]2,kWk, 

[ yk = Hl%^k- 


(59) 


Obviously, system (l59l) is still a periodie system and has the same period r > 0 as (|3]). 

In the following, we show that (l59l) is also /C^-exaetly detectable. Beeause system dU) is /C^-exaetly 
detectable, for any fc > 0, |/j = 0 a.s. for i = k, - ■■ ,k + N , implies that there are constants (3^ > 1 and 
0 < Ao < 1 such that 


EWxtW'^ = E\\(t)k+t,kXk\? < /3oE\\xk\\‘^xS 


(60) 


for any /c"-unobservable state Xk- Take Xk = Srjk = S 


0 

V2,k 


, with 7j2^k being a /c^-unobservable state 


of (l59l) . i.e., yi = Hl^ri 2 ,i = 0 for i = fc, • • • , fc -f iV. Then yi = HiS 


0 

V2,k 


= 0 for i = fc, • • • ,k + N. 


Hence, (l60l) holds. Substituting Xk = S 


into (l60l) yields 


0 

^2,fc ^ 

2 ^ « Z7ll„ ||2x(t-fc) 


E\\v2,t\\ < M\V2,k\\ Eo, t>k. 


(61) 


So (l59l) is /C^-exaetly deteetable. 

Associated with (1591) . the GEE (1571) admits a positive definite solution sequenee {Pk > 0}fc>o. Applying 
Theorem 13.2.11 the subsystem (1591) is ESMS. Sinee ? 7 i,fc+i = E^^ry^k + G]^r]i^kWk has been shown to be 
ESMS, there are eonstants /9i > 1 and 0 < Ai < 1 sueh that 

E\\y,£ <l3^E\\y,,kf\t^\ t>k. (62) 

Set jS := max{/)o,/5i}, A = max{Ao, Ai}, then the eomposite system (15^ is ESMS with 

Ehtf = E\\y^£ + E\\r,2A? < (3E\\ykfX^'-^\ t > k, 


whieh deduces that the periodie system dS]) is ESMS because dS]) and (15^ are equivalent. ■ 

Einally, we eonsider the linear time-invariant stoehastie system (l44l) and present a Eyapunov-type 
theorem as a eomplementary result of Theorem 19 GOll . Assoeiated with (l4^ . we introduee the linear 
symmetrie operator Cf,g, called the generalized Eyapunov operator (GEO), as follows: 


Cf,gZ = EZE'^ + GZG^, Z e Sn- 
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Moreover, for system (1^ . the GLE (l25l) beeomes 

- P + F'^PF + G^PG + H^H = 0. (63) 

Theorem 3.2.3. Suppose that a{CF,G) C © := {A : |A| < 1} and {F,G\H) is exactly detectable. If P 
is a real symmetric solution of ^3\l . then P > 0 and {F, G) is stable, i.e., the state trajectory of is 
asymptotically mean square stable. 

In order to prove Theorem I3.2.3[ we need to eite the well-known Krein-Rutman Theorem as follows: 

Lemma 3.2.1 (see [|2Ell ). Let jd := maxA.go-(/:pQ) |Aj| be the spectral radius of Cf,g- Then there exists a 
nonzero X > 0 such that Cf,g^ = (dX. 

Proof of Theorem D.2.31 Beeause a{CF,G) © ©, the spectral radius jd <l.lf jd < 1, then this means 
that (F, G) is stable by [|20l Lemma 3], which yields P > 0 according to If20l Lemma 17]. If (d = 1, then 
by Lemma [3.2.1[ there exists a nonzero X > 0, such that Cf,gX = X. Therefore, we have 

0 > {-H^H,X) = {-P + C*p^^iP),X) = (-P,X) + (P,£f,gW) 

= (-P, X) + (P, X) = (0, X) = 0, (64) 

where {A, B) := iia.ce{A^ B), C*pq is the adjoint operator of Cf,g, and C*pq{P) = PF+G^PG. Lrom 
(l64l) it follows that tTace{H^HX) = 0, which implies FIX = 0 due to X > 0. However, according to 
ll20l Theorem 8-(4)], Cf,gX = X together with HX = 0, contradicts the exact detectability of (P, G\H). 
Hence, we must have 0 < (d < 1, and this theorem is verified. ■ 

Remark 3.2.1. Lollowing the line of Theorem 13.2.31 Conjecture 3.1 in ll3^ can also be verified. 

4. Exact Observability 

This section introduce another definition called “exact observability” for system ([3]), which is stronger 
than exact detectability and also coincides with the classical observability when system ([3]) reduces to the 
deterministic linear time-invariant system (O. 

We first give the following definitions: 

Definition 4.1. System (|2]) is called kf-exactly observable if Xk^ = 0 is the unique kf -unobservable 
state. Similarly, system (Ej) is called kl°-exactly observable if Xk^ = 0 is the unique k’f-unobservable 
state. 

Definition 4.2. System (|21) (or (Fk,Gk\Hk)) is said to be lC°°-exactly observable if for any k G [0, cxo), 
system (|2]) is k°°-exactly observable. If for any time k G [0, cxo), there exists a nonnegative integer X > 0 
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such that system (0) is -exactly observable, then system (|21) (or (Fk,Gk\Hk)) is said to be K,^-exactly 
observable. Similarly, the and -exact observability can be defined. 

Combining Lemmas l3.1.H - [3rL2l together, a suffieient eondition for the exact observability is presented 
as follows. 


Theorem 4.1. If rankH^o k = nfor any k>D, then (Fk, Gk\Hk) is IC°°-exactly observable. In particular, 
if rankHk+so,k = n for some fixed integer sq > 0 and any k > 0, then system (13) is not only K°°- but 
also -exactly observable. Here Hi^k is defined in Lemma and 


Hk 

[h ® Hk+i)4>k+i,k 
(J 22 C) Hk+2)4’k+2,k 

(l2i-k C) Hi)(l)i^k 


The next corollary follows immediately from Theorem 14.11 


Corollary 4.1. If Hk is nonsingular for fc > 0, then system (13 is Kfi-exactly observable. 


By Definitions 14.1114.21 kf' (resp. /co“)-exact observability is stronger than /cg° (resp. fco°)-exact de¬ 
tectability. Likewise, /C°° (resp. /C^^, /C^)-exact observability is stronger than /C°° (resp. 

Iqft^ /C^)-exact detectability. A necessary and sufficient condition for the /C^-exact observability was pre¬ 
sented in [l35ll based on the "H-representation theory developed therein. Below, we give another equivalent 
theorem based on Lemma 12.21 


Theorem 4.2. (i) System (|3 is K,^ -exactly observable iff for any k G Nq, the Gramian Ok+N,k is a 
positive definite matrix, (ii) If system (|3 is -exactly observable and {Pk > 0}fc>o solves the GLE 

m, then Pfc > 0 for any k >D. 

Proof: We note that = 0 a.s. for i = fc, /c -f 1, • • • ,k-\- N, is equivalent to Yl\=k = 0- 

Lemma [Z 2 I Yl\lk = E[xl.Ok+N,kXk\ = 0. So system (13 is exactly observable iff Yl\=k = 

E[xlOk+N,kXk] = 0 implies = 0 a.s., which is equivalent to Ok+N. ,fc > 0 due to Ok+N,k > 0. Hence, 
(i) is proved. 

Now we prove (ii) by contradiction. If some Pk^ is not strictly positive definite, then there exists a 
nonzero Xk^ G = 0- By the /C'^^^-exact observability of (Fk, Gk\Hk), there 
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is So > 0 such that system ([3]) is /cQ°-exactly observable. Since the following identity 

S 

E[xlPkXk]-E[x^^^^Ps+iXs+i] = '^E\\yi\\'^ (65) 

i=k 

holds for any s > /c > 0, it follows that 

fco+SQ 

0 — ^ ^ ~ ~-^[^A:o+so+l-^fco+«o+l^fco+^*o+l] — 0 

i=ko 

and accordingly yi = 0 a.s. for i G [fco, fco + so]- By the /i;o°-exact observability, Xko = 0, which contradicts 
Xko 7 ^ 0. Hence, (ii) is proved. ■ 

Remark 4.1. Theorem I4.21 (D shows that the /C^-exact observability is weaker than the uniform observ¬ 
ability given in |[8l, where it was proved that system ([3]) is uniformly observable iff there are N > 0 and 
7 > 0 such that Ok+N,k > 7-^ for any k E A/q- 

Remark 4.2. There is no inclusion relation between uniform detectability and exact observability. For 
example, in Example I3.1.4[ {Pk\Hk) is /C^-exactly observable, but it is not uniformly detectable. On the 
other hand, in Example 13.1.51 {Ek\Hk) is uniformly detectable, but it is not /C°-exactly observable. 

Similar to exact detectability, we also have the following inclusion relation for exact observability: 

/C^-exact observability /C^^-exact observability 
/C'^^^-exact observability /C°°-exact observability. 

The following Lyapunov-type theorem can be viewed as a corollary of Theorem 13.2.1[ 

Theorem 4.3 (Lyapunov-Type Theorem). Assume that system (|2]) is a periodic system with the period 
r > 0. If system (|21) is K.^-exactly observable for any iV > 0 and {Pk > 0}fc>o solves GLE t l25l) . then the 
periodic system (|2]) is ESMS. 

Proof: By Theorem 14.21 (111. > 0 for k > 0. Because A^^-exact observability must be A^^-exact 

deteetability, this theorem is an immediate corollary of Theorem 13.2.11 ■ 

5. Additional Comments 
At the end of this paper, we give the following comments: 

(i) In [|22l|, ll27ll . Il37ll . exact observability and detectability of linear stochastic time-invariant systems 
with Markov jump were studied. How to extend various definitions of this paper to linear time-varying 
Markov jump systems is an interesting research topic that merits further study. 
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(ii) Following the line of [[^ that transforms the system ([3]) into a deterministic time-varying system, 
it is easy to give some testing criteria for uniform detectability and observability of ([3]) by means 
of the existing results on deterministic time-varying systems [|2^ . In addition, applying the infinite¬ 
dimensional operator theory, the spectral criterion for stability of system ([3]) is also a valuable research 
issue. 

(iii) In view of Remarks 13.1 .3143X41 we know that, for linear time-invariant system (l44l) . stochastic 
detectability implies exact detectability. In ifJTll . it was shown that exact detectability is equivalent to 
the so-called “W-detectability” (see llJTl Definition 3]). A new definition called “weak detectability” 
was introduced in [1^ . where a counter-example (see Example 15 in (1301) shows that W-detectability 
does not imply weak detectability. In particular, it was proved in [|^ that weak detectability can 
be derived from stochastic detectability. It is easy to prove that weak detectability implies exact 
detectability. In summary, we have the following inclusion relation: 

stochastic detectability ^ weak detectability ^ exact detectability W-detectability. 

As stated in If^ . the converse implication that whether W-detectability or exact detectability implies 
weak detectability is an open question. 

(iv) Lemmas 12.1112.21 are important, which will have potential applications in mean stability analysis and 
system synthesis. 

(v) This paper reveals some essential differences between linear time-varying and time-invariant systems. 
For example, for linear time-invariant system (l44l) . exact detectability and exact observability can be 
uniquely defined, but they exhibit diversity for LDTV system (|3]). Moreover, many equivalent relations 
in linear time-invariant system (l44l) such as 

uniform detectability exact detectability, uniform observability exact observability 
do not hold for LDTV system dS]). 


6. Conclusion 

This paper has introduced the new concepts on detectability and observability for LDTV stochastic 
systems with multiplicative noise. Uniform detectability defined in this paper can be viewed as an extended 
version of that in [[Tl. Various definitions on exact detectability and observability are extensions of those in 
0, Biol, 11331, BMl, [1361 to LDTV stochastic systems. Different from time-invariant systems, defining exact 
detectability and exact observability for the time-varying stochastic system ([3]) is much more complicated. 
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We have also obtained some Lyapunov-type theorems under uniform deteetability of LDTV systems, 
/C^-exaet deteetability and /C^-exaet observability of linear diserete periodic systems. We believe that 
all these new concepts that have been introduced herein will play important roles in control and filtering 
design of LDTV systems. 
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